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Abstract. Nous etudions et comparons trois notions de convergence de types dans une theorie stable : 
le convergence logique, c.a.d., formule par formule, la convergence metrique (toutes deux deja bien 
etudiees) et la convergence des bases canoniqucs. 

(i) Nous caracterisons les suites qui admettent des sous-suites presque indiscernables. 

(ii) Nous etudions les theories pour lesquelles la convergence metrique coincide avec la convergence 
des bases canoniques (a priori plus faible). Pour les theories Ho-categoriques nous caracterisons 
cette proprietc par la Ko _ca tegoricite de la theorie des belles paires associee. En particulier nous 
montrons que c'est le cas pour la theorie des espaces des variables aleatoires. 

(iii) Utilisant ces outils nous donnons des preuves modclc thcoriques a des resultats sur les suites des 
variables aleatoires figurant dans Berkes & Rosenthal IBR85I . 

We study and compare three notions of convergence of types in a stable theory: logic convergence, i.e., 
formula by formula, metric convergence (both already well studied) and convergence of canonical bases. 

(i) We characterise sequences which admit almost indiscernible sub-sequences. 

(ii) We study theories for which metric converge coincides with canonical base convergence (a priori 
weaker). For No-categorical theories we characterise this property by the Ko-categoricity of the 
associated theory of beautiful pairs. In particular, we show that this is the case for the theory of 
spaces of random variables. 

(iii) Using these tools we give model theoretic proofs for results regarding sequences of random vari- 
ables appearing in Berkes & Rosenthal BR85 . 



Introduction 

The motivation for the present paper comes from probability theory results of Berkes & Rosenthal 
BR85] . These results have a strong model theoretic flavour to them: for example, the use of limit tail 
algebras (canonical bases of limit types), existence of almost exchangeable sequences (almost indiscernible 
sequences), distribution realisation (type realisation), compactness of the distribution space (type space 
compactness), and so on. 

The appropriate model theoretic setting for this analysis is the continuous logic theory of atomless 
random variable spaces, ARV. Types in this theory correspond precisely to conditional distributions, 
and each of the notions of convergence of conditional distributions considered by Berkes & Rosenthal has 
a corresponding notion of convergence of types. It is easy to check that weak convergence of distributions 
corresponds to convergence in the logic topology (which is indeed the weakest natural topology on a type 
space). We also show that strong convergence of distributions corresponds to metric convergence of types, 
as well as to canonical base convergence. Indeed, showing that metric and canonical base convergence 
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agree in ARV is an essential step in our proof that strong convergence corresponds to metric convergence. 
Modulo all these translations, the main theorem of [BR85] has a clear model theoretic counterpart, 
regarding existence of almost indiscernible sequences, which we prove in Section [2] 

Generalising to an arbitrary stable theory, we see three topologies on the space of types which we 
compare: 

(i) The logic topology is the weakest topology we consider (since it is compact, it is minimal among 
Hausdorff topologies). 

(ii) The canonical base topology is defined in terms of convergence of the canonical bases of the 
types. It is stronger than the logic topology, and over a model it is strictly stronger. 

(iii) The metric topology is defined in terms of convergence of realisations of types. It is the strongest 
of the three. 

A theory for which the two last topologies agree is said to be SFB (strongly finitely based). Such theories 
are considered in Section [3] In particular, we prove a useful criterion for SFB under the assumption of 
N -categoricity. 

Theorem. A stable theory T is No- categorical and SFB if and only if the theory Tp of lovely pairs of 
models of T (as per Poizat |Poi83] ) is ^-categorical. 

It follows easily that several familiar continuous theories, such as those of Hilbert spaces, probability 
algebras and random variable spaces, are SFB. On the other hand, it also follows from this theorem that 
the theory of atomless L p Banach lattices is not SFB, contrary to the situation in classical logic where 
every No-categorical, No-stable theory is SFB (Zilber's Theorem). On the other hand, we do prove that 
the theory of beautiful pairs of L p lattices is No-categorical up to perturbation of the predicate defining 
the smaller structure. By analogy, one may say that the theory of L p lattices is SFB up to perturbation. 
It is natural to ask whether every No-stable, No-categorical theory is SFB up to perturbation, and even 
to conjecture that this is always the case. 

In Section 2] we go back to the article of Berkes & Rosenthal. This is where we establish a correspon- 
dence between probability theoretic notions and their model theoretic counterparts in the theory ARV, 
as alluded to above, using the fact that ARV is SFB. Under this translation, we prove several of Berkes 
and Rosenthal's results, including their main theorem, as special cases of model theoretic facts. 

Throughout this paper we assume that T is a stable continuous theory. We assume that the reader 
is familiar with basic facts regarding stability and continuous logic, as presented in BU]. For material 
regarding the theory ARV we refer the reader to [Bene] . Other background material includes Poizat 
Poi83] for beautiful pairs and Pillay [Pil96] for Zilber's Theorem and its consequences for No-categorical 
strongly minimal (and more generally, No-stable) theories. 

1. Convergence of types and canonical bases 

Fix to £ N, an m-tuple x, and a set of parameters A. Then the space of types S n (^4) is equipped with 
the standard logic topology (i.e., the minimal topology in which all definable predicates are continuous), 
as well as with a metric 

d(p, q) = min{o?(a, b): a 1= p and b \= q\. 

The distance between two finite tuples is defined as the maximum of the distances between coordinates. 
The metric on S m (^4) is stronger than the logic topology. 

We obtain two notions of convergence in S m (A): p n —* p and p = limp„ will mean that the sequence 
(Pn)neN converges to p in the logic topology, while p n — > d p and p = lim d p„ will mean convergence in 
the metric. Since the metric defines a stronger topology we have p n p => p n —* p. 
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We can extend these notions of convergence to types of infinite tuples. The logic topology is defined as 
usual for spaces of types of infinite tuples, so there is nothing to worry about. On the other hand, there 
is no canonical metric on infinite tuples. Indeed, on uncountable tuples there is no (definable) metric 
at all. Instead we observe that in the finite case, p n — > d p if and only they admit realisations a n and a 
such that a n — ► a in the product topology, i.e., such that a n< k — > for all k < m, and we can define 
d-convergence of types of infinite tuples accordingly. In the case of countable tuples this does indeed 
correspond to a definable metric. Among the many equivalent possibilities, we (arbitrarily) choose 

(Since the distance between any two singletons is at most 1, this converges to a value which is at most 
1.) . 

Since we assume the theory to be stable, we can come up with yet another notion of convergence of 
stationary types (to be more precise, this is a notion of convergence of parallelism classes) . Recall from 
BU that for every formula (p(x,y) there exists a definable predicate d x ip(y, Z), where Z — {z n ) n ^ 
consists of countably many copies of x, such that for every stationary type p{x) over a set A, its ip- 
dcfinition is an instance d x (p(y, C) which is (equivalent to) an A-dcfinablc predicate. Moreover if p is 
over a model M then we can choose C C M, and (by |Bendj ). if (a„)„ 6 N is a Morley sequence in p then 
C = (a n ) will do as well. 

We define the (p-canonical base of p, denoted Cb v (p), as the canonical parameter of the definition 
d x ip(y, C). Let Scb„ be the sort of canonical parameters of instances d x (p(y, Z). This sort is equipped 
with a natural metric: if c and c' are the canonical parameters of d x cp(y, C) and d x cp(y, C), respectively, 
then 

d(c,c') = swp\d x tp(y,C) - d x ip(y,C')\. 
y 

Thus, if M \= T and p(x),q{x) £ S„(M), then: 

d(C\(p),Cb v (q)) - sap\(p{x,by-(p(x,b)"\. 

beM 

Now let $(i) the set of all formulae of the form tp(x, y) (so x is fixed while y may vary with ip). The 
canonical base of p(x) is defined as: 

cb(p) = (cb^))^ )S)e$(s) . 

This is usually viewed as a mere set (i.e., the minimal set to which p has a non-dividing stationary 
restriction), but we will rather view it as an infinite tuple indexed by <&(x), i.e., living in the following 
infinite sort which only depends on the tuple x: 

Scb{x) = Y\. ^ Cl v 

Converge of infinite tuple is, as with finite tuples, defined through pointwise convergence: 

Cb( Pn {x)) -> Cb(p(x)) <=^> C\( Pn ) -> Cb v { P ) for all ip G 

Since the language is assumed to be countable, Cb(p) is a countable tuple. Let us enumerate $(x) = 
{<Pn}neN- As we pointed out above, the pointwise convergence topology (i.e., the product topology) is 
given by the metric: 
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In case the tuple of variables x is infinite there is no great difference. We define as the set of all 
formulae of the form tp(x', y), where x' C x is a finite sub-tuple. For tp 6 we may still define Cb v (p) 
as before (note only that the information contained in tp includes the precise sub-tuple x! : otherwise we 
would need a more explicit notation such as Cb v ^/(p(x))). We then define Cb(p) = (Cb v (p))^ e$ ^ 
and everything works essentially as in the finite case. 

We can now sum up everything in the following definition. 

Definition 1.1. Let (p n (x)) ngN be a sequence of types in S Q (A), and p(x) £ S a (A) (a may be finite or 
infinite). 

(i) If a = m < u, we say that the sequence (p n )n d-converges to p, in symbols p n — > d p or 
p = lim p n , if p n converges to p in the metric space (S m (A), d) . In case a is infinite, we say 
that p n — > rf p if for every finite sub-tuple x! C x, the restrictions to x' converge: p n \%> Pis'- 

It is not difficult to see that for a < u> this is equivalent to the existence of realisations 
a n N Pn and a N p such that a n — > a. 

(ii) If all the types are stationary then we say that the sequence {p n )n Cb-converges to p, in symbols 
p n — * cb p or p = lim cb p„, if Cb(p n ) — > Cb(p). If not all types are stationary, then p n — > cb p if 
they have extensions to strong types over A, say q n and q, respectively, such that q n — > cb q. 

(iii) We say that the sequence (p n )n converges to p, in symbols p n — ► p or p = limp„, if it converges 
in the standard logic topology, i.e., if tp Pn — > tp p in [0, 1] for every formula ip(x) 6 C(A). 

Remark 1.2. We have p n — >rf p if and only if they have extensions to strong types over A, say q n and q, 
respectively, such that q n q. 

Proof. A converging sequence a n — > a which witnesses that tp(a n /A) — > d tp(a/j4) also witnesses that 
stp(a n /A) — > d stp(a/A), and vice versa. Bi.2 

Lemma 1.3. Let (p n )nen be a sequence of types in S Q (^4) and p £ S a (j4) for some a < uj. Then the 
following imply one another from top to bottom: 

(i) Pn -^ d P- 

(ii) p n ^ Cb p- 

(iii) p n -> p. 

(Of course, if p n -^> d P then p n — > p without having to assume that T is stable.) 

Proof. By Remark 11.21 and the definition of p n — ► p, we may assume that all types are strong. 

(i) (ii). Since p„ ^ d p, we can find realisations a n N Pn and a N p such that a„ — > a. Let 
C = (d n )n£N and let (C^a^j^ be a Morley sequence in tp(Ca/A), & — (a^)„. Then each sequence 
(a J n )j is a Morley sequence in p„, (a- 5 ).,- is a Morley sequence in p. We also have (a J n )j — ► {d J )j, whereby 
Cb(p„) -» Cb(p). 

(ii) ==> (iii). Let 6) be a formula with parameters in A, and let d s tp{y, Z) be the uniform tp(x, y)- 
definition. Then 

tp{x,b) Pn = d x tp(h, Cb v (p„)) -> dxtp(b, Gb v (p)) = </?(i,6) p . 
As this hold for every formula over A, we have p n — > p. B1.3 

The converse implications do not hold in general. 

2. Almost indiscernible sequences and sub-sequences 

For simplicity of notation, we state all the results in this section to (sequences of) singletons, but the 
same holds for arbitrary tuples. 
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Definition 2.1. A sequence (a n ) ne ^ is almost indiscernible if there exists an indiscernible sequence 
(& n )„gN in the same sort such that d(a n , b n ) — * 0. 

Lemma 2.2. Let (a n ) n ^ be an almost indiscernible sequence, say witnessed by an indiscernible sequence 
(&n)nGN; and let B D (a n ) n . Then p — limtp(a n /S) exists and is stationary, and Gb(p) C dcl(a„)„. 
Moreover, (b n ) n ^ is a Morley sequence OTpTcbCp)- 

Proof. Let B' = B U {b n } n . Since T is stable, r = limtp(6„/£?') exists and is stationary, and (b n ) n 
is a Morley sequence in r tcb(r)- Moreover, for every k and formula ip(x,y), Cb v (r) is the canonical 
parameter for d x if(y, (b n )n>k) ■ Consider now an automorphism of an ambient monster model which 
fixes (o„)„. For k large enough, it will move the tail (&„)„>& as little as we wish, and therefore fix Cb(r). 
Therefore Cb(r) C dcl(a n ) n C dcl(B). 

Clearly limtp(a„/-B) = limtp(6„/-B) = r\ B , so in particular the first limit exists, call it p. Since 
Cb(r) C B, the type p is stationary, Cb(p) = Cb(r) C dcl(a„)„. Finally, rf cb(r) = pf cb(p ). U 2 .2 

In a discrete sort, an almost indiscernible sequence is just one which is indiscernible from some point 
onward, so having an almost indiscernible sub-sequence is the same as having an indiscernible sub- 
sequence. In metric sorts, however, the two notions may differ and it is the weaker one (namely, having 
an almost indiscernible sub-sequence) which we shall study. 

Definition 2.3. Let B be a set containing a sequence (a„) ng N- We say that (a n ) n satisfies (*b) if 
p = limtp(a n /-B) exists and is stationary, and for C — Cb(p) and cNpwe have: 

tp(Ba n /C) -+ d tp(Bc/C) 

If B = {a n } n we omit it and say that (a n ) n satisfies (*). 

Remark 2.4. If B Z> B' then (*b) => (*B'), by Lemma [2~2l (so in particular (*b) => (*))■ In addition, 
the condition (*b) is equivalent to: 

There exists a stationary type p £ S(B) such that if C = Cb(p) and c N p then 
tp(Ba n /C) ~* d tp(Bc/C). 
Indeed, this already implies that tp(a n /_B) tp(c/B). 

Our main result concerning existence of almost indiscernible sub-sequences is the following: 

Theorem 2.5. If T is stable and the sequence (a n ) ne N C B has a sub-sequence satisfying then 
(a„)„ S N also has an almost indiscernible sub-sequence. If T is superstable then the converse holds as 
well. 

Moreover, if in addition q = limtp(a„/-B) exists then it is stationary and the sequence witnessing 
almost indiscernibility is Morley over Cb(q). 

Proof. We may assume that the sequence (a„)„ satisfies (*b), and therefore (*). Let A — {a n } n C B 
and let p = limtp(a„/A), C = Cb(p), c N p, so c A\^ c A. 

We construct by induction on i 6 N an increasing sequence (ni)i and copies A l c l of Ac, A 1 — {a l n } n , 
such that: 

(i) dia^a* 1 ) for j<i. 

(ii) d{c\a^)<±. 

(iii) A l c l = c Ac. 

(iv) d± c c<\ 

We start with A°c° = Ac. At the zth step we already have A 1 , c l , and n<j. By (*) there exists k such 
that: 

d(tp(a n<i a k /C),tp(a n<i c/C)) < ~. 
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We let rii = k, and we may assume that > n,- for j < i. Since Ac =c A l c l , there exists A l+1 \= tp(A/C) 
such that 

This takes care of the first two requirements. Choose c i+1 N p\ c such that c z+1 c A l+1 c- 1 . Then 
the two last requirements are satisfied as well, and the construction may proceed. 

For each i, the sequence (a J n .)j is Cauchy, converging to a limit b l , and we have d{c l ,b l ) < 2~' i+2 . 
Also, the sequence (c l )i is indiscernible (being a Morley sequence in p\c), and (b l )i =c (anji- Thus 
(a„) admits an almost indiscernible sub-sequence (a ni )i. 

For the moreover part, we may again assume that the entire sequence (a„)„ satisfies since the 

limit type, if it exists, must be equal to the limit type of any sub-sequence. Then the statement follows 
from Lemma \2. 2 1 

For the converse we assume that T is superstable, and we may further assume that (a n ) n is almost 
indiscernible as witnessed by an indiscernible sequence (c n ) n - By Lemma 12.21 p = limtp(a n /-B) exists 
and is stationary, and (c„)„ is a Morley sequence over C — Cb(p). Let c N p, so c B. 

Fix a finite tuple b C B, and e > 0. By superstability there exists n E N such that b e X Cc c„. In 
other words, there exists b' = a ci(Cc<„) b such that d{b, b') < s and b' X< Cc c «- By transitivity, V c„, 
in which case b'c n =c be. This proves that tp(Bc n /C) ^ d tp(Bc/C). Since d(a n ,c n ) — > 0, it follows 
that tp(Ba n /C) -^> d tp(Bc/C) as desired. ^2.5 

Below we shall relate Theorem 12.51 to the main theorem of Berkes and Rosenthal ,BR85 . 
3. Strongly finitely based (SFB) theories and lovely pairs 

3.1. Comparing type space topologies. Fix a model M of T, n G N, and an n-tuple x. The type 
space S„(M) is usually equipped with two topologies, the logic topology Tc and the metric topology 
Td. In Definition 1 1.1 1 we introduced (for a stable theory T) a third topology Tcb of Cb-convergence, and 
we showed that Tc C 7cb Q %i- It is natural to ask whether these inclusions are proper. First of all it 
is fairly clear that in the uninteresting case where M is compact, all three topologies agree. We shall 
therefore assume that M is not compact. 

Lemma 3.1. The first inclusion T^ C 7cb *s proper. 

Proof. Let a 6 N >z M, a ^ M, and let e — d(a, M)/2 > 0. Let p = tp(a/M), and consider the following 
7cb-neighbourhood of p: 

S={q: d(Cb d (p),Cb d (q)) < 
= {q:\d(x,b) p -d(x,b) q \<e V6 € M} 
C {tp(a'/M): d(a',M) > e}. 
In particular S contains no realised type, and therefore has empty interior in Tc- B3.1 
We are left with the question of when 7cb = Ti- 

Definition 3.2. We say that a theory T is strongly finitely based (SFB) if for every model M \= T and 
every n, the topologies Tcb and Td agree on S n (M). 

For every p 6 S„(M), and every formula <p(x,y), the canonical parameter Cb v (p) belongs to 
an imaginary sort M v of M. Our definition of canonical bases can now be viewed as a mapping 
CbM,™: S n (M) — > Let us denote the range of CbM.n by C n (M). This is the set of 

all canonical bases of n- types over M; equivalently, this is the set of all tuples (in the appropriate sorts) 
in M which can be obtained as the canonical base of a stationary n-type (over any set of parameters). In 



ALMOST INDISCERNIBLE SEQUENCES AND CONVERGENCE OF CANONICAL BASES 



7 



fact it can be seen that C n (M) is type-definable in M, where the defining partial type does not depend 
on M. Since the type can be recovered from its canonical base, the mapping Cb M,n is injective, and by 
definition Cbjvf,™ : (S„(M), 7cb) —* C n {M) is a homeomorphism. 

Proposition 3.3. Assume that T is SFB. Then T is ^-stable. 

Proof. Let M be a separable model. Then Il^esfs) M v is a separable metrisable space (as the 
countable product of such spaces). As any subset of a separable metrisable space is separable, 
C n (M) C ]1 e $/ s) M v is separable, and therefore (S„(M), T ch ) is separable. Since T is SFB, (S„(M), d) 
is separable. B3.3 

3.2. Beautiful pairs and SFB. In this section we give a characterisation of Ko-categorical SFB theories 
in terms of the corresponding theory of beautiful pairs. Let us recall a few facts regarding definable sets 
in continuous logic. 

Definition 3.4. Let M be any structure, X C M a possibly large subset, A C M a set of parameters. 
We say that X is (A-) definable in M if it is closed and the predicate d(x,X) is definable (over A). 

Definable subsets of M n are defined similarly. 

Fact 3.5 ( [Benaj or [BBHU08 ). Let M be a structure, X C M a closed, possibly large subset, ACM 
a set of parameters. Then the following are equivalent: 

(i) The set X is A-definable. 

(ii) For every A-definable predicate ip(x,y), the predicate ip{y) = inf xe jf ip(x, y) is A-definable as 
well. 

In addition, every compact set is definable, and the union of any two definable sets is definable (by 
d(x, XUY) = d(x, X) A d(x, Y) ). 

(On the other hand, the intersection of two definable sets need not in general be definable.) 
Let us also recall the following result, due to the third author. For a proof see [BU07 . 

Fact 3.6 (Ryll-Nardzewski Theorem for metric structures). Let T be a theory in a countable language. 
Then the following are equivalent: 

(i) T is Ho- categorical, i.e., admits a unique separable model up to isomorphism. 

(ii) T is complete and for each m G N. the metric topology and the logic topology on S m (T) agree. 
(hi) T is complete and the metric topology and the logic topology on S W (T) agree. 

In particular, if X is any type- definable set (without parameters) in an Ho- categorical theory then the 
predicate d{x,X) is metrically continuous. Thus the function tp(x) <— > d(x,X) is logically continuous, 
namely, a definable predicate, so X is definable. 

(Notice that the separable models include any possible compact model of T, so Ho-categoricity implies 
completeness by Vaught's Test.) 

Concerning beautiful pairs we shall be brief, following [Poi83] fairly closely. We define an elementary 
pair of models of T to be a pair [M, TV), where N -< M N T. We view such a pair as a structure (M, P) 
in Cp = C U {P}, where P is a new 1-Lipschitz unary predicate symbol measuring the distance to N, 
and we may also write N = P(M). A beautiful pair of models of T is an elementary pair (M, P) such 
that P(M) is |£| + -saturated, and M is Ho-saturated over P(M). We define Tp as the £p-theory of all 
beautiful pairs of models of T. If saturated models of Tp are not beautiful pairs (which may happen, for 
example, if T is a classical stable theory with the finite cover property) then continuous first order logic 
is not adequate for the consideration of the class of beautiful pairs. (On the other hand, positive logic 
always provides an adequate framework, see |Ben04| .) If saturated models of Tp are beautiful pairs then 
continuous first order logic is adequate and we shall say that the class of beautiful pairs of models of T 
is almost elementary. 
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Lemma 3.7. The class of elementary pairs of models of T is elementary. We shall denote its theory by 
Tpfi. 

Proof. Let P(M) denote the zero set of P. The property P(x) = d(x, P{M)) is elementary by [BBHU081 
Theorem 9.12]. Modulo this property we may quantify over P (uniformly - see also Bcna, Proposi- 
tion 1.8]), and we may express that P(M) < M by 



sup 



sup </?(y, a;) - svpy{y,x) 
v yeP 



0. 



■3.7 

We need an analogue of Poi83 , Theoreme 3]: 

Lemma 3.8. Let A C M 1= T , p G S„(^4), and let f(x, y) be a formula where \x\ = n. Letp\ M C S„(M) 
be the family of all non-dividing extensions of p. Then there exists an A-definable predicate ip(y) such 
that for all b G M: 

ifj(b) — sup ip(x, b) q . 

q£p\ M 

Proof. Let qo G S„(M) be any non-dividing extension of p to M, and let x(y, Co) be its (^-definition, 
where cq = Gb v (qo) is the canonical parameter. Let C be the orbit of cq over A. Then C is compact, and 
by Fact 13.51 the predicate t^iv) = sup csC x(s, C) is definable. It is moreover A-invariant, and therefore 
definable over A. 

On the other hand, the (^-definitions of the other non-dividing extensions of p to M are precisely 
those of the form c) where cgC, whence the desired identity. B3.8 

Let <p(x 7 y) and ip(y,z) be formulae, and let 

= { sup inf \/ (p(x,yi) ^ip(yi,z)) = > 
I" v X i<n J ne n 

In other words, M N ^^^(c) if and only if the following partial type is consistent (and therefore realised 
in an elementary extension of M) : 

{<p(x,b) < ip(b,c)}- beM . 

Lemma 3.9. Assume that the set defined by tt v .^ is definable in models of T. Then the following is 
true in every beautiful pair of models ofT. 

(2) sup inf sup (ip(x, y) - ip(y, z)) = 0. 

zt=7r Vl y x iJGPU{2} 

(The set P U z is definable as the union of a definable set with a compact set.) 

Proof. Let c S M realise tt^^. Then the partial type {ip(x,b) < ip(b, c)}^ p(Jg is consistent. Since M is 
Ho-saturated over P, this partial type is realised by some a G M. B3.9 

Lemma 3.10. Assume again that the set defined by tt v ^ is definable in models ofT. Let T' P consist of 
Tp q (namely the axioms saying that P is the distance to P(M) ■< M \=T), as well as of all instances of 
@. Then every Hi-saturated model ofT' p is a beautiful pair. 

Proof. Let (M, P) \= T' P be Hi-saturated. We only need to prove that M is Ko-saturated over P. Let 
c G M and let p(x) G S n (Pc). Fix a formula tp(x,y). By Lemma T3.8I there exists a definable predicate 
iptp(y) with parameters in P U c such that for all b G M, 

ip v (b) = sup ip(x, b) q . 

q£p\ M 
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It follows that {(p(x,b) < VvWJsgM ^ s consistent. For k 6 N choose a formula ip^.kiViCk) which 
approximates ^(y) up to 2~ fe , where c C c k C P U c (and iptp,k{V^k) is parameter- free). We may 
further do this in such a manner that ip v {y) < ip Vl k{V> 5*). Thus {y>(x,6) < t/> V) fe(&, 5fe)}g 6Af holds as 
well. By our axioms, the conditions 

SUP ^ ip 9 ,k{y>ck)) = o 

yePue 

are approximately realised in (M, P) , and therefore so is the condition 
(*¥>) sup (<p(x,y) - Vv(£)) = 0. 

We claim that every two conditions of the form are a consequence of a third one of the same kind. 
We do this by the same coding trick as the one used in |BU] , So consider two formulae fi(x, y), i = 0, 1. 
For the sake of simplicity we shall assume that in every model of T there exist two elements of distance 
one, and define 

ip(x,y,w,u) = [-id{w,u) A ip (x,y)] V [d(w,u) A tpi(x, y)]. 

Now let a e M realise ( fej ) (such a exists by saturation) and let t,s £ P, d(t,s) = 1. Thus <p Q (x,y) — 
<p(x,y,t,t) and fi(x,y) = (p(x,y,t,s), whereby ip v (y,t,t) = tp vo (y) and ij} v {y,t,s) = ip Vl (y). Therefore, 
for every b € P U c: 

^o(aJ) - ip w {b) = ip(a,b,t,t) ^ ip v (b,t,t) = 0, 

¥>i(a,6) ^ ^,(6) = (p(a,b,t,s) ^ ip v (b,t,8) = 0. 

Proceeding in this manner, we see that the collection of all the conditions of the form is consistent, 
and by saturation realised in (M, P), say by a. Then for every formula ip(x, y) and every b G P U c we 
have 

^3(6,6) < ^,(6) = sup ip(x,b) p = ip(x,b) p . 

q€p\ M 

Replacing with -k/j we obtain <p(a, b) = y>(x, b) p , i.e., a N p, as desired. B3.10 

Proposition 3.11. Assume T is ^-categorical (and stable, as is assumed throughout this paper). Then 
the class of beautiful pairs is almost elementary. 

Proof. Since T is Ko-categorical, the set defined by tt v ^ above is definable. The assertion now follows 
from the two preceding Lemmas, and we obtain in addition that T' P = Tp. B3.11 

Lemma 3.12. Let [M, P) be a pair of models, x an n-tuple, and ip(x,y) € &(x) a formula. Then the 
mapping a 1— > Ch v (a/P) is uniformly definable in (M, P), i.e., its graph is definable by a partial type 
which does not depend on [M, P) . 

Proof. The graph of z = Gb v {x/P) is defined by: 

P(z) = & sup|y(x, y) - d s ip{y, z)\ = 0. B3.12 

y£P 

It follows that for every m we have a uniformly definable mapping 0: (M, P) m — * C m (P) inducing a 
continuous function 9: S m (Pp) — > Scb(m)(^) given as follows (here Scb(m)(^) is the space of types in 
the sort Scb(s)) where x is an m-tuple). 

6: a ^ Cb(a/P), 

(3) 

0: tp Cp (a) ^ tp £ (Cb(a/P)) = tp(0(a)). 
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Fact 3.13. Let (M,P) and (N,P) be two beautiful pairs of models of T and let a £ M and b £ N be 
two tuples of the same length. Let C = 9(a) = Cb(a/P(M)) and D = 9(b). Then tp £p (a) = tp Cp (b) if 
and only if tp(C) = tp(D). 

Proof As in [Poi83l Theoreme 4] (notice that tp(C) = tp(D) if and only if tp M (a/P(M)) and 
tp N (b/P(N)) are equivalent in the fundamental order of T). B3.13 

Proposition 3.14. Assume the class of beautiful pairs of models of T is almost elementary. Then the 
mapping 9 defined above is a homeomorphic embedding. 

Proof. Since 9 is a continuous mapping from a compact space into a Hausdorff space, all we need to 
show is that it is injective. So let (M,P),(N,P) 1= T P , a £ M, b £ N, and C = 9(a), D = 9(b). 
Then we need to show that C = c D => a = £p b. We may replace both (M,P) and (N,P) by |£| + - 
saturated elementary extensions. By assumption (M, P) and (N, P) are beautiful pairs and we may 
apply Fact 13.131 ■3.14 

Theorem 3.15. Let T be any stable continuous first order theory. Then Tp is ^-categorical if and only 
if T is ^-categorical and SFB. 

Proof. Assume first that Tp is Ko-categorical. Then clearly T is Ko-categorical (indeed, if S m (Tp) is 
metrically compact then so is S m (T)). 

So fix m £ N and let x be an m-tuple. We shall in fact prove a uniform version of SFB, namely that 
for every e > there is S > such that if N 1= T and p,q £ S m (N) are such that d(Cb(p) , Cb(q)) < S 
(where the distance between canonical bases is as defined in ([T])), then d(p,q) < e. For simplicity of 
notation we shall assume that m = 1 and drop the bars. 

Recall from Lemma 13.121 that the mapping 9: a<—> Cb(a/P) is uniformly definable in Tp. Let r(x,y) 
be the partial £p-type saying that x =p y. Since Tp is Ko-categorical, the distance d(xy, r) is a definable 
predicate. Consider now the partial £p-type consisting of {d(xy,r) > e/2} U {d(9(x) 7 9(y)) < 6}s>o- 
This partial type is contradictory, whence we obtain a 5 > such that 

d(9(x),9(y)) <5h- d(xy, r) < e/2. 

We claim that this 5 is as required, i.e., if N N T, p, q £ Si (AT), and d(Cb(p), Cb(q)) < S, then 
d(p, q) < e. Indeed, passing to an elementary extension and taking non-dividing extensions of the 
types we may assume that N is |£| + -saturated, and then find M >- N which is |Ar| + -saturated, so 
(M, N) = (M, P) N T P is a beautiful pair. Let C = Cb(p), D = Ch(q), so d(C, D) < S. 

By our saturation assumption there exist a, b £ M such that oNp and b N q, so 9(a) = C, 9(b) = D, 
and therefore d(ab, r) < e/2. In other words, there exist a'b' £ M such that d(ab, a'b') < e/2 and a'b' 1= r, 
i.e., tp(a'/N) = tp(b'/N) = p', say, and 

d( P , q) < d(p,p r ) + d(p', q) < e/2 + e/2 = e. 

Conversely, assume that T is Ho-categorical and is SFB. By the metric Ryll-Nardzewsky Theorem, 
we need to show that for each m, the logic topology and the metric topology on S m (Tp) coincide. In 
other words, we need to show that if p n — ► p in S m (Tp), then p n —> d p there. 

Assume then that p n — > p. Since T is Ko-categorical, the class of beautiful pairs of models of T is 
almost elementary (Proposition 13 . 1 lj) . By Proposition 13.141 the mapping 9: tp Cp (a) 1— > tp c (Cb(a/P)) 
is a topological embedding, so 9(p n ) — > 9(p), and since T is Ko-categorical we have 9(p n ) 9(p). In 
other words, in a sufficiently saturated model N \= T we can find infinite tuples C n N 9(p n ) and C \= 9(p) 
such that C„ — > C. 

Write C = {c v } vS $( S ), and let q £ S m (N) be the unique type over N such that Cb(q) — C, i.e., 

(p(x,b) q = d x (p(b,c v ), b£ N,ip £<P(x). 
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Define q n G S m (N) such that Cb(q n ) = C n similarly. Then q n -^ ch q by definition, and since T is SFB, 
Qn —> <?■ Let a n N q n and a N 5 witness this, so a„ -» a in some M >z N, which we may assume to 
be |iV|+-saturated, so (M,N) is a beautiful pair. Write it rather as (M,P) \= T P (where P(M) = N). 
Then 9(a) = C \= 9(p) implies p = tp Cp (a), and similarly tp Cp (a n ) = p n . Thus a n — » a witnesses that 
Pn —* P, and the proof is complete. B3.15 

3.3. Examples. First, we consider a class of examples which relates our SFB property with classical 
first order logic. Recall an important corollary of Zilber's Theorem regarding No-categorical strongly 
minimal sets. 

Fact 3.16 ([Pil96, Theorem 5.12]). An ^-categorical, ^Q-stable classical theory is one-based. 

Proposition 3.17. Let T be a classical ^-categorical (and stable) theory. Then the following are 
equivalent: 

(i) T is SFB. 

(ii) T is Ho -stable. 

(iii) T is one based. 

(iv) T is finitely based (meaning that for every m there exists k such that every indiscernible sequence 
of m-tuples, is a Morley sequence over its first k elements). 

Proof. (i) =>■ (ii). We have already seen that SFB implies Ko-stability. 

(ii) => (iii). By Fact EH] 

(iii) (iv). Immediate (k = 1). 

(iv) =>■ (i). Let us fix m — 1 and the corresponding k. Then the type of an indiscernible sequence 
(of singletons) is determined by the type of the first k + 1 members of that sequence, so only finitely many 
types of indiscernible sequences exist. On the other hand, if (M, P) 1= Tp and a e M, then tp^ (a) is 
determined by the £-type of Cb(a/P), which in turn is determined by the type of a Morley sequence in 
tp(a/P). We conclude that Si(Tp) is finite, and by similar reasoning so is S m (Tp) for all m. Therefore 
Tp is No-categorical, so T is SFB by Theorem 13. 151 B3.17 

This result does not generalise to the case of a stable Ho-categorical continuous theory. For the 
direction "one-based =>■ SFB" we merely observe that the proof given above does not carry over to the 
metric setting. For the direction "SFB =>• one-based" we present below several counter-examples. 

Example 3.18. The theory of infinite dimensional Hilbcrt spaces IHS is SFB. 

Proof. Let IHS' P consist IHSpfi together with the axiom scheme expressing, for each k, that there exist 
k orthonormal vectors which are orthogonal to P (we leave the details to the reader, pointing out that 
since P is definable modulo IHSp, one may quantify over it). It is then not difficult to check that every 
beautiful pair of models of IHS is a model of IHS P , so IHS' P C IHSp. On the other hand, IHS' P 
admits a unique separable model (H © Hi , H) where H = Hi 1= IHS are separable. Thus IHS' P is 
complete, so IH S' P = IHS P , and IHS is SFB by Theorem [313 B^g 

Example 3.19. The theory of atomless probability algebras APr is SFB. 

Proof. The argument is essentially the same as above. We define APr' P to consist of APr Pj o along with 
the axiom saying that M is atomless over P, expressible as 

sup inf sup I \n[x (~1 z] — n[x n y n z] I =0. 

x v zep 

Then again every beautiful pair is a model of APr' P and APr' P admits a unique separable model, namely 
(Q5(X x Y),*B(X)) where X = Y = [0,1] equipped with the Lebesgue measure, and the embedding 
«8(X) ^> Q5(X x Y) is induced by the projection X x Y -» X. B 3 . 19 
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Both of the examples above are K -categorical and K n -stable, so it is natural to expect them to satisfy 
some continuous analogue of finite basedness. It is not difficult to verify that none of them is one-based. 
In fact, no known continuous stable theory is one based, except for those constructed trivially from 
classical ones. Given the examples above, and in analogy with Proposition I3.17i it stands to reason 
to contend that at least for Ho-categorical theories, SFB is the correct continuous logic analogue of a 
classical one-based theory, and one may further formalise it as a conjecture: 

Conjecture 3.20 (Zilber's Theorem for continuous logic, naive version). Every Ko-categorical Ko-stable 
theory is SFB. 

Unfortunately, this conjecture has an easy counterexample: 

Example 3.21. The theory ALpL of atomless L p Banach lattices for p £ [1, oo) (sec [BBH ) is not SFB. 

Indeed, a model of ALpLp is of the form (L p {X, 23 a", Px), L p (Y, Q3y , py)) , where 2V C 23 a" (so in 
particular 7 CI) and py = Px tgj y j sucn that in addition py is atomless and px is atomless over 23y. 
The theory ALpLp has precisely two non isomorphic separable models, one where Y — X and the other 
where p(X \7)>0. 

We may construct them explicitly as [L p (X x Y), L p (X)) and (L p (Z x Y), L p (Xy\, where X = Y = 
[0, 1]CZ = [0, 2] are equipped with the Lebesgue measure, the embedding L p (X) C L p (X x Y) is given 
by f'(x,y) = f(x) and L p (X x Y) C L p (Z x Y) is given by f'(w) = f(w) for w £ X x Y, f'(w) = 
otherwise. 

It is worthwhile to point out that this last example is disturbing on several other "counts" : 

• It is a counter-example for Vaught's no-two-models theorem in continuous logic. 

• Since ALpL is Ko-stable, ALpLp is superstable by [Ben06j . and we get a counter-example to 
Lachlan's theorem on the number of countable models of a first order superstable theory. 

Nonetheless, one may still hope to recover a version of Zilber's Theorem for continuous logic using the 
notion of perturbations of metric structures (as introduced in |Benb| lBen08] ). Natural considerations 
suggest that whenever adding symbols to a language (especially to the language of an H -categorical 
theory) one should also study the expanded structures up to arbitrarily small perturbations of the new 
symbol. Thus, the question should not be whether ALpLp is No-categorical, but rather, whether it is 
Ko-categorical up to small perturbations of the predicate P (the positive non-perturbed results for IHSp 
and APrp should be viewed witnessing the exceptional structural simplicity of these theories). 

Proposition 3.22. The theory ALpLp is ^-categorical up to arbitrarily small perturbations of P. 

Proof. We need to show that if (M, P), (iV, P) 1= ALpLp are separable then there exists an isomorphism 
p: M —> N such that \d(f,P) - d(p(f),P)\ < e for all / £ M. Since ALpL P has precisely two non- 
isomorphic separable models, it will suffice to show this for those two models. 

Let N, Mi and M 2 be the closed unit balls of L p ([0,l]), L P ([0,1] x [0,1]) and P p ([0,2] x [0,1]), 
respectively (with the Lebesgue measure). As in the example above, we consider that N C Mi C M%. 
In particular, N is the set of all g £ Mi such that the value of gix, y) depends only on x. Then the two 
non-isomorphic models are (Mi, JV) and (M2,iV). 

Define p x : L p ([0, 1] x [0, 1]) -» L p ([0, 1] x [e, 1]) and p 2 : L p ([l, 2] x [0, 1]) -> L p ([0, 1] x [0, e]) by: 

( Pl f)ix,y) = (1 - e)-^f(x, (y - e)/(l - s)) 

(p 2 f)(x,y) = e~ 1 /Pf(x + l,y/e). 

Then p\ and p 2 are isomorphisms of Banach lattices, which can be combined into an isomorphism 
p = pi p 2 : L p ([0, 2] x [0, 1]) — » L p ([Q, 1] x [0, 1]). This restricts to an isomorphism of the unit balls 
which will also be denoted by p: M 2 M\. Let also D = [0, 1] x [0, e] and E = [0, 1] x [e, 1], namely 
the supports of the images of p 2 and pi, respectively. 
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We claim that p\ N : N — > Mi is not too far from the identity. Indeed, let g £ N. Then \\g\\ < 1, 
and we can write it as a function of the first coordinate g(x). Then p(g) — p\(g) can be written as 
(1 - e)- 1 / p g{x)xE(x, y). For r 6 [0, 1] let: 

C(r) = 1 - (1 - r) 1 ' p + r 1 /*. 

Then: 

\\g - P(g)\\ < \\9xe (i - £)- 1/p 9xe\\ + WqxdW 

= \\g\\ (l-^^ + ILglle 1 ^ 

= ||5||C(e) < COO- 

Now let / e M 2 . Then: 

III/ - .911 - \W) g\\\ = | \W) - P(g)\\ \W) - g\\\ 
<\\g- P {g)\\<ae)- 

Fixing / £ M2 while letting g € N vary, we conclude that: 

\d(pf, P)(^.^0 - P)^) I = |d(/, 2V) - d(p(/),JV)| 

<sup|||/-.g||-||p(/)- 5 ||| 

geN 

Since C is continuous and C(0) = 0, by taking e > small enough we can get p: (M2, AT) — > (Mi, iV) to 
be as small a perturbation of the predicate P(x) — d(x, N) as we wish. H3.22 

We therefore propose the following: 

Conjecture 3.23 (Zilber's Theorem for continuous logic). Whenever T is an Ho-categorical Ho-stablc 
theory (in a countable language) Tp is Ho-categorical up to arbitrarily small perturbations of the predicate 
P. 

4. The model theoretic contents of Berkes & Rosenthal [BR85 

The motivation for this paper has its origins in a theorem from probability theory characterising 
sequences of random variables possessing almost exchangeable sub-sequences. This is the main result 
(Theorem 2.4) of Berkes & Rosenthal BR85 , and has a strong model theoretic flavour to it. In this 
section we translate some of |BR85j to model-theoretic language, and show how their main result is 
essentially a special case of Theorem 12.51 and the fact that the theory of atomless probability algebras 
(or rather, of spaces of random variables over such algebras, see below) is SFB. 

4.1. The theory of [0, l]-valued random variables. Let us recall a few facts from |Bencl Section 2]. 
Let fl be a probability space, and M = Li(0, [0, 1]) the space of all [0, 1]- valued random variables, 
equipped with the L\ distance. We view M as a metric structure (M, 0, -1, \, — ) where the function 
symbols -1, h and — are interpreted naturally by composition. We shall also use E(X) as an abbreviation 
for d{X, 0), namely the expectation of X. The class of all such structures is elementary, axiomatised by 
a universal theory RV . 

The probability algebra associated with f2 can be identified with the set of all characteristic functions 
in Li(fl, [0, 1]), and this set is uniformly quantifier-free definable in models of RV, and will be denoted 
by # '. For A C M, let a (A) C J? M denote the minimal complete sub-algebra with respect to which 
every X G A is measurable (so in particular <r(M) = j? M ). 
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The theory RV admits a model companion ARV, whose models are the spaces of the form Li(fl, [0, 1]) 
where f2 is atomless. The theory ARV is No-categorical (whereby complete), No-stable and it eliminates 
quantifiers. Furthermore, non forking in models of ARV coincides with probabilistic independence. In 
other words, A ± B C if and only if ¥[X\a(BC)] = P[X\a(B)} for every X e a (A) (or, equivalently, for 
every X G a(AB)). 

The theories RV and Pr (the theory of probability algebras) are biinterpretable. Indeed we have 
already mentioned that the probability algebra is definable in the corresponding random variable space. 
Conversely, using a somewhat more involved argument, one can interpret, in a probability algebra 
the space of random variables £i(J^, [0, 1]), such that for M N Pr and N N RV: 

M = jrMM.Io.i]), N = Ll (& N , [0, 1]). 

This biinterpretability specialises to the theories ARV and APr, and transfers to the corresponding 
classes of elementary pairs and of lovely pairs. It follows that ARVp is No-categorical as well, its unique 
separable model being (Li(^", [0, \]),L\(P{&), [0, 1])) where (&,P) is the unique separable model of 
APr p. Thus ARV is SFB. (One can also show directly that SFB is preserved under biinterpretability, 
without using Theorem 13. 15i and thus without any No-categoricity assumption.) 

Definition 4.1. Let stf be a probability algebra. An n- dimensional distribution over stf fl is an 
Li(s>/, [0, l])-valucd Borel probability measure on K n (cr-additive in the L\ topology, and jl(M. n ) is the 
constant function 1 £ L\(stf ', [0, 1])). The space of all n-dimensional distributions over srf will be de- 
noted Dinfrf). For a Borel set B C E™, we denote by the space of n-dimensional conditional 
distributions which, as measures, are supported by B (we shall only use this notation for B — [0, 1]™). 
Let X be an n-tuple of real-valued random variables. The joint conditional distribution of X over 
denoted here by fl = dist(A > |^') (and by c • dist(X) in [BR85] ) is the n-dimensional distribution 
over srf given by 

[1(B) = P[X € B\gf\, B C R™ Borel. 

Recall that a net (Xi)i e j C L\(si , [0, 1]) converges in the weak topology to X if for every Y 6 
L\{srf , [0, 1]), E[XiY] — * E[XY]. The net (Xj) converges to X in the strong topology if it converges in 
L x . 

Definition 4.2. Following BR85, Proposition 1.8], say that a net (jli)iei of n-dimensional distribu- 
tions over srf converges weakly (strongly) to /2 if for every continuous function 9: K n — > [0, 1] we have 
J 0(x) dfli(x) — > J 6(x) dp(x) weakly (strongly). 

Let us make two remarks regarding this last condition. First, if 9: [0, l] n — > [0, 1] is continuous then 
the mapping X \— * 9(x) is uniformly definable in models of RV. This follows immediately from the 
fact that 9 can be approximated arbitrarily well by £/{y-terms (i.e., by the operations \ and — ). 
Second, by the Stone- Weierstrass Theorem, every continuous 9 can be arbitrarily well approximated by 
polynomials. It follows that it is enough to consider only monomial test functions x a = Yl x t % ■, where 
a G W 1 . 

Theorem 4.3. Let X be an n-tuple in a model of ARV , A a set. Then the joint conditional distribution 
dist(X\o~(A)) depends only on tp(X / A). Moreover, the mapping 

C: tp(X/A) i — ► dist{X\a(A)) 

is a homeomorphism between S n (A) (equipped with the logic topology) and Sfo ) i]n((j(-A)) equipped with 
the topology of weak convergence. 



Proof. The first assertion, as well as the injectivity of £, are shown in [Bene] . 
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For surjectivity of £ let srf = a (A) and \x G 23[ 0i i]r.(^/). Let Q be the Stone space of the underlying 
Boolean algebra of srf . This is a compact, totally disconnected space, and srf is canonically identified 
with the algebra of clopen sets there. Let also if — 2 N be the Cantor space (where 2 = {0, 1}), also 
compact and totally disconnected. We have a canonical continuous surjection 7r: if — > [0, 1] sending 
a i— ► a n 2~ n ~ 1 . Let 0: [0,1] if be the section which avoids all infinite sequences of ones on [0, 1). 
While it is not continuous, 9 is a Borel mapping. 

Let CI' = CI x if™. For a product B x C C O', where B £ srf and C C if™ are clopen, the set 
_1 C C [0,1]™ is Borel and we may define v{B x C) = E^s/Z^C)] G [0,1]. More generally, any 
clopen set DCfi' can be written as a disjoint union Z) = \J i<m Bi x C, of such products. We then 
define v(D) — J2i< n v {^i x Cj), observing that this does not depend on the specific presentation as a 
finite disjoint union (by passing to a common refinement). Since all the clopen sets in CI' are compact, 
the hypotheses of Carathcodory's theorem are verified, and v extends to a probability measure on CI' . 
For a measurable set B G srf we have v{B x if) = F[B], so the projection CI' — > CI is measure preserving. 
In particular, we may identify with a sub-algebra of the probability algebra of (CI', v). 

Let : CI' — > K be the projection on the ith copy of if and let = irYi. Let BErf 1 and C C if" 
be clopen. Then 

E[l B P[y G CM] = v(B x C) = E[1b/Z(# _1 C)] . 

The same follows for every closed C (since it can be expressed as a countable intersection of clopen sets) 
and therefore for every Borel C. If C C [0, 1]™ is any Borel set then 7r _1 C C if is Borel as well, whereby 

E[1 B P[X e CM] = KB x tt^C) = EflBMO?" 1 ?!- 1 *?)] = E[1 B /J(C)] . 

Thus P[X G CM = [1(C) and p, = dist(X|^). Possibly replacing (ft', v) with (SI', i/) x ([0, 1], A) (where 
A is the Lebesgue measure) we obtain an atomless probability space. Thus M = L\(Sl' , [0, 1]) is a model 
of ARV containing a copy of srf = cr(A), and therefore a copy of A (since dcl(A) = dcl(<r(A))), as well 
as a tuple X G M n such that ((tp(X /A)) = p. Therefore £ is surjective. 

Consider now a random variable Y G L\(srf ', [0, 1]) = del (A) and a G N™. Since the mapping X i— > X a 
is uniformly definable, the mapping X i— > £[yX Q ] is an A-definable predicate. If p = tp(X/^4) and 
p, = A\st(X\^) = C{p) then 

E[Yx a } p{s) = E[YX a ] = E 

Thus the mapping p^E[7/i" d((p)(x)] is continuous in p. By definition of weak convergence, ( is 
continuous. Since S n (A) is compact and 2)[ 0il ]„ (,sz/) Hausdorff, £ is a homeomorphism. ^4.3 

From this point onwards we identify n-types over A with n-dimensional conditional distributions over 
a(A). In particular, from now on we shall omit £ from the notation, writing J dp(x) where before we 
wrote J d((p)(x). Strong convergence of conditional distributions also has a model theoretic counterpart. 

Corollary 4.4 (Quantifier Elimination to Moments). Modulo the theory ARV, every formula <p(x) can 
be expressed as a (possibly infinite) continuous combination of the definable predicates E[x a ]. 

Proof. By the theorem, the mapping p 1— » (E[x a ] p ) QeN „ is a topological embedding 1: S„(0) [0, 1] N ". 
If <p(x) is any formula, then it can be identified with a continuous function ip: S„(0) — ► [0, 1], which, 
by Tietze's Extension Theorem, can be written as <p o 1 for some continuous <p: [0, 1] N " — > [0, 1]. The 
statement follows. >4.4 

In particular, every formula can be approximated arbitrarily well by finite continuous combinations 
of the definable predicates S[S a ]. 

Corollary 4.5. Every sequence (p n ) n C !D[ 0|1 ] m (.sz^) admits a sub-sequence which converges weakly. 



Y 



dp(x) 
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Proof. First of all, we may assume that stf is separable, since we may replace it with 
cr ^{/^n(rii<m[0' 9*1) } n( =N qeQ m ) ' Then S m («K^) is compact and admits a countable basis, so every se- 
quence there admits a converging sub-sequence. B4.5 

In case we wish to consider distributions of R-valued random variables we need to be a little more 
careful. 

Definition 4.6. A family of distributions £ C Sim(^) is tight if for every e > there is R G K such 
that P([-i?,i?] m )||i > 1 - e for all (let. 

We say that a family of m-tuples of random variables is bounded in measure if their respective joint 
distributions form a tight family. 

Let 9: [—00, 00] — ► [0, 1] be any Borel mapping. For p, G 25jam(«e/), we may view p as a member of 
®[-oo oo] m an( i then let 6>*/2 G 2)[ ij™ (^/) denote the image measure under 8, i.e., p*p(B) — p{(6 x • • • x 

Lemma 4.7. Let (p, n ) n C Sgm(^) foe any sequence, and let p: [— 00,00] — + [0, 1] 6e a homeomorphism. 
Then [p n )n converges weakly in Shh(^) i/ and on/y z/ is iig/ii and {p*p n )n converges weakly in 

3) [0 ,l]m(^). 

Proof. For i? > 0, let M m — * [0, 1] be continuous with lr_R fl im < x« < l[-fl-i,ij+i]m. Notice that 
the sequence is tight if and only if, for every e > there is an R such that || J xr dp n \\i > 1 — e for all n. 

For left to right, assume that p n — > /2 weakly. Then — > weakly. For tightness, for each e > 
there exists i?o such that || J \r dp\\\ > 1 — e. By assumption || j XRo ^Mn||i ~ > II / XRo dp\\i, so for 
some n we have || J xr dp n \\i > 1 — £ for all n > n . Since no is finite, we can also find R\ such that 
II / XRi dftnWi > 1 — £ for all n < n . Let i? = max(i? ,-Ri). Then || J XRdp n \\i > 1 — £ for all n. 

For right to left, we assume that the sequence is tight and that p*p, n — > weakly in S)[ ,i] m Then 
there exists /Z G 2)[-oo,oo] m (^) such that = i? and /2 n — > /T weakly in 3Dr_oo,oo] m O^O- By tightness, 
for each e > there is i? such that || J XRdp n \\i > 1 — £ for all n. By weak convergence we obtain 
|| J XRdp\\i >l — e. We conclude that /2(M m ) = 1, i.e., p G IDr™^), as desired. ^4.7 

Corollary 4.8 ( BR85, Theorem 1.7]). Every tight sequence in D^m^ji/) has a weakly converging sub- 
sequence. 

Theorem 4.9. Let A be a set of parameters, and identify S n (A) with D n (a(A)) as above. Then the 
topologies of d- convergence, Cb- convergence (of types) and strong convergence (of distributions) agree. 

Proof. Since ARV is SFB, we already know that d-convergence and Cb-convergence agree. Let us first 
show that d-convergence implies strong convergence. Let M be a large model containing A, and let 
a G N n . Then the mapping X 1— » S[X"|ct(A)] is a continuous mapping M — » Li(a(A)), where both are 
equipped with the usual L\ metric. It follows that the mapping p 1— > J x a dp(x) is a continuous mapping 
(S n (A),d) — > Li(ct(A)). Thus d-converges implies strong convergence. 

We now prove that strong convergence implies Cb-convergence. For this purpose we need to show 
that for every formula tp(x,y), the mapping that associates p <— * Cb^p) is continuous when equipping 
S n (A) with the topology of strong convergence. By our observation above, it is enough to show this 
where <p(x,y) = £ , [x Q y' 3 ] (strictly speaking, this is a definable predicate and not a formula, but this 
makes no difference). If X G M and Y G dcl(A) then 

<p(X,Y) = E[X a Y fi ] = E[Y f} E[X a \a{A)}] 

Thus the mapping tp(X/A) 1— » E[A >a |cr(A)] uniformly yields a parameter for the i?[a; Q y^]-defmition of 
tp(X /A), and it is continuous when equipping S„(A) with the topology of strong convergence. B4.9 
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4.2. Exchangeable and indiscernible sequences. We are about to compare various model theoretic 
definitions and results with their probability theoretic counterparts which appear in Berkes & Rosenthal 
BR85 . A word of caution is in place, regarding the fact that Berkes and Rosenthal consider R-valued 
random variables, whereas we prefer to consider [0, l]-valued ones. This can be overcome, observing that 
(with one exception, which we shall treat explicitly) only topological (and not, say, algebraic) properties 
of R are actually used, and that R can be topologically identified with (0, 1) C [0, 1]. 

The following definitions were given in [BR85] for sequences of single random variables. We give the 
obvious extensions to sequences of tuples of a fixed length. 

Definition 4.10. Let (X„)„ g N be a sequence of m-tuples of random variables, X n = (X nt Q, . . . , X n:m _i). 

(i) Let ^ D cr{{X n ^i] n ^ be any probability algebra with respect to which all the X n ^ are mea- 
surable. Then the sequence is determining in ^ if the sequence dist(X n |^) converges weakly 
in T>Rrn(ff). (We use an alternative characterisation from [BR85I Proposition 2.1].) 

(ii) Let (X n ) n be a determining sequence of ^-measurable random variables, and let fl € SDr™^) 
be the limit distribution. Then the limit tail algebra BR85 p. 474] of (X n ) n is a{fT) = 

^({/j(n(-oo,g 4 ))} fgQm )cif. 

(iii) The sequence is exchangeable if the joint distribution (over the trivial algebra) of any k distinct 
tuples of the sequence depends only on k. 

(iv) The sequence is almost exchangeable if there is an exchangeable sequence (Y n ) n ^ such that 
J2 n ,i \ x n,i ~ Yn,i\ < °° almost surely. 

While Berkes & Rosenthal consider the ambient probability algebra as fixed (this is in particular 
apparent in their definition of a determining sequence), the model theoretic setting suggests that we 
allow it to vary. Conveniently, this has no effect on the definitions: 

Fact 4.11. A sequence (X n ) is determining in some ¥t > % — a^{X n } n ^j if and only if it is determining 
in l^o . Therefore, from now we just say that a sequence is determining. 

Proof. Follows from the fact that if fJ n are conditional distributions over % and fl a conditional distri- 
bution over 'if D fo, then fl n — > ft weakly as conditional distributions over f if and only if fl is in fact 
over fo and fl n — * fl weakly as conditional distributions over fo. I4.11 

By Theorem l4.3[ (X n ) n is determining (in 'f, say) if and only if the sequence (tp(pX n /f)) converges 
in S m (f) to some tp(pY /ff), where Y is R m -valued random variables. On the other hand, if we only 
know that (tp(pA > „/ c ^')) n converges in S m (^), say with limit tp(Z/^), then Z consists of [0, l] m - 
valucd random variables, so Y = p~ x Z consists of [—00, oo] m -valued random variables, which need not 
necessarily be R m -valued. 

Lemma 4.12. Let (X n ) n be an R m -valued sequence, and let ^ D a({X n } n ). Then the sequence is 
determining if and only if: 

(i) The sequence (tp(pX n /'£')) converges in S m (^); and: 

(ii) The sequence (X n ) n is bounded in measure. 

Proof. Immediate from Lemma 14.71 B4.12 

Proposition 4.13. BR85, Theorem 2.2] Every sequence of R m -valued random variables which is 
bounded in measure has a determining sub-sequence. 

Proof. Immediate from Corollary 14.81 B4.13 

Clearly, a sequence {X n ) n is exchangeable if and only if it is an indiscernible set (or more precisely, 
if and only if the (0, l) m -valued sequence (pX n ) n is). Of course, since ARV is a stable theory, every 
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indiscernible sequence is indiscernible as a set, so exchangeable is synonymous with indiscernible. This 
observation is part of the statement of [BR85I Theorem 1.1]. The full statement is that an indiscernible 
sequence of random variables is conditionally i.i.d. over its tail field. This can also be obtained as an 
application to ARV of the following three facts: that in a stable theory, if (a„)„ is any indiscernible 
sequence, then it is a Morley sequence over C = f] n dcl e<? ({afc}fc>„); the characterisation of the definable 
closure given above; and that in models of ARV, canonical bases exist in the real sort. 

On the other hand, being almost exchangeable is not invariant under a homeomorphism of M. with 
(0,1), so something needs to be said. Recall first that if (X n ) n is a sequence of uniformly bounded 
random variables then X n — > in L p , for any 1 < p < oo, if and only if X n — > in measure. 

Lemma 4.14. Let p: K — > (0, 1) be any continuous injective function, and let (X n ) and (Y n ) be sequences 
of M.-valued random variables. 

(i) If \X n - Y n \ < oo a.s. then \pX„ - pY n \ ->0tnli. 

(ii) Assume conversely that \pX n — pY n \ — > in L\, and that the sequence (Y n ) n is bounded in 
measure. Then there exists a sub-sequence for which Y \X nk — Y nk \ < oo a.s. 

Proof. For the first item, notice that p is necessarily uniformly continuous. If Y \X n — Y n \ < oo a.s. then 
by standard arguments \X n — Y n \ — > in measure, in which case \pX n — pY n \ — > in measure. Since 
\pX n — pY n \ are bounded random variables, |||0-X* n — /oi^||i — > 0. 

For the second item we assume that \pX n — pY n \ — > in L\, or equivalently, in measure, and that (Y n )„ 
is bounded in measure. We first claim that \X n —Y n \ — > in measure. Indeed, let e > 0. Then there 
exists R € K such that P[|F„| > R] < e for all n. Let K = p[[-R, R]] , K\ = p[[-R -e,R + s]]. Then 
Kq C K° C K\ C (0, 1), and since K\ is compact, p^ 1 is uniformly continuous on K\. In particular, 
there exists 5 > such that if x, y E K\ and |ar — yj < 8 then \p^ 1 (x) — p^ 1 {y)\ < e. Possibly taking 
a smaller 8, we may assume that K\ contains a (^-neighbourhood of Kq. Since \pX n ~ pY n \ — ► in 
measure, for n big enough we have \pX n — pY n \ < 8 outside a set of probability e. Thus, outside a 
set of probability 2s we have both \pX n — pY n \ < 8 and rng(pl^.) C Kq, whereby rng(pX„) C K\ and 
therefore \X n — Y n \ < e. This concludes the proof that X n — Y n — > in measure. We may now pass to a 
sub-sequence such that P[|X n( . — Y nk \ > 2~ k ] < 2~ k , and it is easy to check that then Y \X nk — Y Uk \ < oo 
a.s. B4.14 

Lemma 4.15. Let (X n ) n be a sequence of M. m -valued random variables. 

(i) Assume that (X n ) is almost exchangeable. Then it is bounded in measure. 

(ii) Assume that (X n ) is bounded in measure. Then it has an almost exchangeable sub-sequence if 
and only if the sequence (pX n ) n has an almost indiscernible one. Moreover, in that case, the 
indiscernible sequence witnessing almost indiscernibility is (0,l) m -valued. 

Proof. For the first item, it is clear that an exchangeable (and more generally, an identically distributed) 
sequence is bounded in measure. Assume now that (Y n ) n witnesses that (X n ) n is almost exchangeable. 
As in the proof of Lemma [4.141 we have X n — Y n — > in measure, and the statement follows. 

We now prove the second item. For left to right, we may assume that (X n ) n is almost exchangeable, as 
witnessed by (Y n ) n . By Lemma [4.141 the sequence (pY n ) n witnesses that (pX n ) n is almost indiscernible. 

For right to left, we may assume that (pX n ) n is almost indiscernible, as witnessed by an indiscernible 
sequence (pY n ) n (where the Y n j are, a priori, [— 00, oo]-valued). Let c if — o~({X n }n) . Then the limit 
p = limtp^Yn/^) exists, whereby the limit limtp(pA„/ ( ^') = p exists as well. Let pY \= p. By 
Lemma 14.121 (X n ) n is determining and Y is M m -valued. Since Y n = Y (over 0, even though not 
necessarily over ^), each Y n is R- valued as well. Now, again by Lemma [4. 141 there exist sub-sequences 
(A„Jfc, (Yn k )k such that \ x n k ,i ~Y nk ,i\ < 00 a.s. U 4 . 15 
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Finally, a word regarding the limit tail algebra of a determining sequence. Let M = L 1 ^, [0, 1]) be 
a big saturated model of ARV, c ta C & a sub-algebra, and let (X n ) n be a determining sequence of "im- 
measurable random variables. Let Y realise the limit distribution over measurable in & (although not 
necessarily in ^). Then the tail measure algebra of (X n ) n is precisely srf = (r({E[(pF) Q |'^']} ae N m ) C ^, 
which is interdefinable with Cb(pY / c g) = Cb(pY/M). 

After all this translation work it is relatively easy to show that the main theorem of [BR85; is indeed 
a special case of our Theorem 12.51 

Theorem 4.16 ([BR85, Main Theorem (2.4)]). Let (X n ) n be a sequence of random variables in a 
probability space (CI, It?, p). Then (X n ) n has an almost exchangeable sub-sequence if and only if it has 
a determining sub-sequence whose conditional distributions ( with respect to the limit tail algebra of the 
sequence), relative to every set of positive measure, converge strongly. 

Moreover, if in addition (X n ) is determining then the sequence witnessing almost exchangeability is 
i.i.d. over the limit tail algebra. 

Proof. We may view ^ as a sub-algebra of a rich atomless probability algebra and work in M — 
L x (&, [0, 1]) N ARV. Since almost exchangeable and determining sequences are bounded in measure, 
we may assume that (X n ) n is bounded in measure. 

Under this assumption, the first condition is equivalent to saying that (pX n ) n admits an almost 
indiscernible sub-sequence. Regarding the second condition, a sub-sequence (X nk )k is determining if 
and only if (tp(A ? „ fc /^')) fe converge to some type p £ S m (*<?). In this case the limit tail algebra is 
interdefinable with Gb(p), and the conditional distributions dist(A > „ fc , S\s/) converge strongly for every 
S G if and only if tp(pX nk , / srf) converge in (S(^), 3cb), or equivalently, in (S(g/), S^d). 

Thus the statement of the theorem is equivalent to saying that the sequence (pX n ) n has an almost 
indiscernible sequence if and only if it has a sub-sequence with the property (*<g>). This is just a special 
case of Theorem 12.51 (and the same for the moreover part). B4.16 

Corollary 4.17 ([B B85( Theorem 3.1]). A sequence of random variables has an almost i.i.d. sub- 
sequence if and only if it has a sub-sequence whose distributions relative to any set of positive measure 
converge to the same limit. 

Proof. Let (X n ) n be the sequence, and let ^ denote the ambient probability algebra in the statement, 
and we may embed ^ in a model M N ARV . 

Following the same translation as above, if (X n ) n is almost i.i.d., say as witnessed by (Y n ) n , then 
limtp^Xn/^) = ]imtp(pY n / e if) = p, say, and Cb(p) C dcl(0). In other words, if pZ \= p then ^ Z, 
meaning precisely that the distribution of Z relative to any non zero member of is the same. 

Conversely, assume that limdist(A > „|S') = limdist(A > „) = p, say, for every / S £ f . Let Z 
realise p independently of c € . Then dist(A > „|'^ 7 ) — > dist(Z|' r ^') weakly, so the sequence is determining, 
and since Z c € the limit tail algebra is trivial. Also, since dSs,t(X n \£~) dist(Z| c ^') weakly, we have 
dist(A > n ,^) — ► dist(Z, (weakly or strongly, over the trivial algebra it is the same thing), so passing 
to a sub-sequence we may assume that (X n ) n is almost exchangeable, say witnessed by (Y n ) n . By the 
moreover part of the theorem, this sequence is i.i.d. H4.17 
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